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INTRODUCTION ' ~ > * ^ 

v 

Rationale and Overview of the Project ; 4 

Title I. of the EJ^aent^fy and Secondary Education Act of 1965 fE^EA) is • ' 
the primary prbgr^oT^ederal assistance for elementary and secondary educa- 
tion. It provides funds "to counties, and School districts in area's with high/ 
proportions of low inqome^ families, in order to improve the academic achieve- 

men t of educationally deprived' children. Local education agencies (LEAs) 

. ? 

are allowed" considerable discretion in using Title I funds, as lone as services 
provided supplement rather than replace %tate and local efforts, and address local 
ne^eds as determined by annytal assessment. As a result-, Title I funds a wide* 
variety. 3^rograms and services in LEAs across the nation reflecting the 
diversity among these Agencies. 

.Since 1965 LEAs have, been required to evaluate the effectiveness of programs 
assisted under Title I. This task .has- proved more difficult than originally an- 
ticipated. In 1975 the U^S. Education Department (USED) contracted with Research 
Management Corporation (RMC) to develop a set of evaluation models to help guide 
the required local and stat % e reporting of 'evaluation data. RMC recommenced 
a system with three alternative models^for assessing the effectiveness of 
Title, I programs: a norm- referenced design; a ^b^trol group design; and a 
special fegressioa design. Each of the three has two forms /- one for, use 
with nationally jiormed tests and the other for use- with tests; without 
national norms. Under this system, results of local evaluations can be 
aggregated by using a connon metric, the normal curve equivalent (NCE) , to 
yield an overall' assessment, of effects (Tallmadge and Wood, 1976). 

Fof programs serving children below second grade, this evaluation system 

• • . - . • ( i 

is of limited usefulness for the following reasons; 

K % The models *re mandated to fk%%t%% program effects only for reading, 

mathematics, and language arts, areas in' which adequate norm-referenced 
tests are commonly-available; whereas early childhood Title J programs 
* often encompass a much wilder range of goals;*' 



. . * Measurement' of young children^ achievement is general 1 /less reliable 
than th^t of older children; 

• Few tests for young -children have adequate norms* and 

• •Early childhood programs often have long-range goals, * V 
the evaluation of which raise#special problems. 

Thus tjie current ESEA Title, I evaluation system is often not/directly applicable 
to programs for children below second grade. For this reason, and in response to 
requests item local, and state education agencies for help in Evaluating such pro- 
grams, the USED awarded a contract to the Huron Institute in 19~7 to- study early 
childhood/it-le I (ECT-I) programs, and to develop materials to help in evaluating 
them. Xhe work, comprises »four phases: a review of the literature of ECT-I evalua- 
^tioj/and instrumentation (Haney, et al., 1978); a description, of 'the nature" -of ECT-I 
jgrams.and the* ways they are being evaluated (Yurchak S Bryk', 1979); an examina- 
tion of the feasibility of developing an evaluation system for ECT-I projects (Bryk 
et al., 1978); and the development of resource materials to assist in the design • 
and conduct of evaluations useful to local school personnel '( forthcoming). -- : 

The second phasj of work, described ^ ESEA Title*! Early Childhood Education : 
A Descriptive Report (Yurchak S Bryk, 1979), "is sunariztd in this document. v 
Eocus of This Report 

The Veport citetf above describes ,^>d analyzes the nature of early childhood 
programs currently supported under Title I. It is based primarily on information 
gained from field visits to ten. state education, agencies (SEAs) and twenty-nine 
LEA^. Additional sources inc^J^e: ESEA Title I Early Education: Review of 
Literature on Evaluation arid Instrumentation (Haney, et al . , 1978);' a telephone 
survey with state Title I coordinators ; "FY 1976 state Title I evaluation reports; 
and description* of exemplary early childhood* Title I programs found in the USED 
publication, Education Programs Tnat Work (1977) . 
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For purpo^fes of work done under this contract, early childhood and ECT-I are 

ed ML programs for children in first grade, kindergarten, and prekindergarten 
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The^first three sectipns of this report- summarize the field research 
method and provide a description of ECT-I 'programs and the current evaluation 
practices associated with them. The fourth section analyzes particular facets * 
' of ECT-I practices. Here, we locate ECT-I programs within the broad trends in 
early childhood education, -describe recruitment, needs assessment*, and selec* v 
tion of children fm ECT-I programs, examine issues of curriculum and resources, 
and investigate the relations between ECT-I programs and the broader educational 
and social communities in which they reside. The last section on parent education 
\ describes parent involvement activities in EGT-I programs "and current ftfactices * 
; of evaluating these activities. . . * 

DESCRIPTION OF FIELfi RESEARCH 
Selecting the Visit Sites - 

Field sites were selected on the bisis of three considerations: geographic 
^ and demographic diversity; demonstrated interest ajld investment in ECT-I programs; 
and thoughtful attends to evaluate these programs. * We identified candidate sites 
froih our review of SEA Title I Evaluation ,Reports<*f©r FY 1975 and FY 1976, from' 
interviews with. t{te Technical Assistance Genters (TACs) , from an informal telephone 
survey-of SEA- Title I directors ,van£ from our advisory *panel . States to visit were 
then fleeted in consultation with representatives of the, 'USED Title I Program 

Office and the Office of Evaluation and Dissemination. LEA sites were selected in 

* _ ■ » 

1 k 
consultation with SEA pfficials- in the states selected. Almost half of the LEAs 

chosen were'urban 'communities with populations of more than 100,000-. Thirty-four 

percent had populations of fewer than* 50,000. The sample included urbip., suburban, 

radically. All of the 



and rural" connunities in states widely distributed geographically. All of the libs 
toncentrated thei& Title I furfdr on programs below- fourth grade. All had at 
l*ast one^ program at the eafrly^ childhood level Together they provided - x 
'different combinations of programs over the prekindergarten, kindergarten 
• and 'first-grade years.. 



Conducting and Reportin g FieW Visits ' .\ 

Each site, was visited bv a'teaa of twn k< * * 

kn a w^ . '* ^erienced interviewers, one- 

I-*** - -Won and,^ in ^ em • ^ ^ , 

■ «x.. varied in ^ ^ on . the sit , of th< i£A . t \- 

. » .«» - ««.. aw > lB , 0Bt , SEA : 

o-fici.l, accompanied Huron itaff 0 „ ^ slte viJit f / 

Held visitors gathered information on s.v.„ 

i " on on "ven topics: protram context: 

program goals an d structure; »e/ecti V on procedures; parent involvement;^™ 
equation procedures; current users and' uses * evaWion i^tion* 
-d needs, capacities, an,' incentives for • addition! evaluation information \ 
. H- extensive notes tafcen during eac^ interview .and observation were organized ' 

• by these seven information categories and transcribed' «W 

4 ranscriDed - Senior project staff 

. conducted cross-c,ase 'analyses. * , 

. ; ».f.r. present^ , we ^ „ ittm ,-, ^ , f ^ ^ 

• . d..r.. to- * lc h our finding can oe „„, rlIiMd t0 ^ ^ ^ ^ . ' 

. i Pro,™. ». IitI , i projec „ visited w<re tei . ectej precjjeiy ; ecmM . _ 

. did nave EOT- pro,™ or components, fluencies of parcicur.r 

of ECT-I pro.rams or practices reported her, -cannot o. „f, ly ia . nllzfi 
TltL I projects nationwide. Nevertheless... f , el c0 „ fidm thM ^ _ V 
stud, encompassed fairi^ider*,,, rf*. 5pectru . , f ^ 

being implemented throughout th^tountry • aad th.t w. k ' 

wwuntr>, a^d that we have an, accurate and 

complete descriptive information about service * , 

•owe services delivered and eurrent evalua- 
"on practices in *. , it „ ^ ^ L^^^^ V 
■ y to , t .c. and offlcllI , f „ ^ ^ cTi^Ttr^^^i 

descriptive information. », , r , S0Mwh , t . • . . ■ 

V " omewnat less confident about the comprehensive ._ " 

ERJC 7 ■ - ■ 
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ness and validity of ihfojrotion directly pertinent to Title I rules and re^ula- 

- # * 
^tiojis, such, as selection 'procedures , needs assessment, parent advisory councils, 

and use of evaluation results. m . Two reasons underly this uncertainty. First,' 
several of -these issues pertain to program compliance with Title I rules 
ajxi regulations. We purposefully did not inquire directly into compliance issues 
because we did not want our field visits to be perceived by local personnel as 
e ^\lf S ty state or * ederai Title I offices to monitor their compliance with 
Title I rules and regulations. Second, unlike other facets of program implementa- 
tibn, we could not directly observe participant selection, needs assessment, 
, parent advisory Councils and use of evaluation, information. As a" result, findings* 
regarding these" issues are based strictly on interlocutors' descriptions and > 
observations regarding them and/or pertinent written descriptions. 

DESCRIPTION OF ECW PROGRAMS - 

''%''' 
We organised our description of'ECT-I programs around "nine variables: 

grade level (prekindergarten, kindergarten and first grade); goals and objec? 

tives (subject -specific objectives such>s reading, reading readiness, mathe- 

matics, and language arts and developmental objectives such as social, emotional, 

1 -psychomotor , cognitive and language acquisition); primary program -recipients- 
(child-centered programs, parent centered^programs and parent and chil-d programs); 
program locus (classroom, home or both); duration (amount of instructional time 
planned for each teaching session) ; staff-child ratio (the number of adults regu- 
larly available tq* children) ; and Title ? instructional staff (teachers, classroom 
aides, special subject teachers, special subject aides, . resource teachers, 
resource center aides, and home visitors). 

We found that ECT-I programs vary considerably across the three 
grade levels of the early childhood domain: * prekindergarlen, kindergarten, and 

p first grade. • „ 4 V' «. 
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Prekindergarten Programs 



Most prekindergarten programs are separate entities, 'only peripherally 
related to LEA activities in later grades : Many prekindergarten programs origi- 
nated Ainder other funding^ sources and were then assiped under Title I. In , 
general, the long-term goals of these programs are %p <i$velop sdjool^eadiness 
and prevent later educational deficits. The programs address a wide range of 
goal areas --including cognitive, langukffc, emo'tionar, sbcial, gross.motor, psycho 
motor, organizational, and motivational deve;oplbent--and emphasize the inter- 
related nature of leanjflng in the several domains. Figure 1 presents a sample 
of typical prekindergarten program objectives/ 

Home-^iool Coordination and parent involvement * is stressed at 'this grade \ 

level. In addition to the required Parent Advisory Council (PACK parent > 

education activities play a prominent rere. "Parent Involvement dtf£tT5~fronv 

, . * " * * 

site to site, but in general parents are taught some err- all of the following: 

*the fundamentals of child development, procedure for teaching specific school 

readiness skills^or for reinforcing skills taught in schoo.1, and strategies. 

f6r motivating children's desirable behaviors and eliminating undesirable 

ones. Parent education programs 'are -sometimes separate from -programs for 

children. More often they supplement % school -based^prog^ms directly serving chi: 

* TWO basic types of program are funded al the prekindergarten level: 

^me-basect and center-based programs. In home-based programs ^eachers. ' 

typically make weekly visits to the mother and child at home. Together 

they play and work on $kijls *hat will be useful when the child enters . 

. r 

scfrbol. - Home-based programs .are somewhat less prevalent and fcost fre^lently 
serve the younger children (three-year-olds), those with unusual deficits, 
or those for whom access to center-based programs is difficult. Often 
they are the first part of a two-year ECT- I program, with children usually 
attending a centef -based program during the second year. > 
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Figure 1; A Sample 'of ECT-I 'Prekindergarten Goals 



s 



DOMAIN 



OBJECTIVES 



Language Arts 



Mathematics 



\ 



Cognitive Development 



Readiness 



Children will demonstrate: 

• A greater degree of language facility as measured by 
*& specified improvement on' a given test 

t Improved sentence structure ' 

• Improved vocabulary and knowledge of word meaning 

• Improved languagi skills 

• Improved language concepts 

• Ilnproved coranunication skills, including listening., 
Speaking, and pre-reading aniLpre- writing 

• Improved ability to comprehend^ interpret and recall 
oral language v 

• Understanding of early mathematics concepts as 
measured by a given test V 

• Ability to understand the vocabulary of beginning 
mathematics 1 

I 'Ability™ to" recognize geometric ffilpes 

• Ability to recognize numbers ' » 

• Ability to count objects 

• Ability to compare similarities and differences 
e Ability to Serialize objects ' 

• Abilityto classify objects 

• Improved math concepts 

• Improved understanding of spatial relationships 
Improved understanding -to sequence objects and/or 
events . 

e Progress in concept development as. measured by a 
given test 
, e General concept development ' 
* e Improved cognitive and intellectual competence 

e Ability to 'think clearly , 

• Ability tc use problem solv^g strategies and 
logi^l reasoning % 

• Ability to test ideas * 

• Increased school readiness 

• Attitudes fnd skills necessary to function in/ school 
-•Improved pre-reading skills 

• Improved pre-ffjathematic&skills 



(Continued. 
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DOMAIN 



Social/f motional 
Development 



OBJECTIVES 



Motivation 



Behavioral Organiza- 
tion ' * , 



Perceptual Motor 
Development 



Motor Development 



• Positive change in affective behavior as reported by 
measures of affective growth J* 

Self confidence 

• Positive self concept (self 'image) 

• Ability to accept himself and others 4 

• Ability to feel and respond to any situation 
appropriately ■ t 

• That they know how to love and be loved 

• Ability to cope with sadness and disappointment 
4 Ability to discriminate between acceptable and , 

^unacceptable behavior 

• Ability to manage "anxiety, anger and jealousy, as 
well as more positive emotions 

• Improved* ski 11 in Social interaction 

• Positive attitudes toward self*, friends, class and 

. * ch001 ' f ' * O 

• Positive attitudes and value? 

• Responsibility and independence 



) 



• Love of learning 
•^Motivational development 

• Improved memory 

• Ability to exerc'ise the will 
•Ability to use self 'discipline 

• Ability to concentrate 

• Ability ;to set goals and initiate actions to complete 
them ' 

• Ability to persevere until \asks are completed 

• Increased attention span 

• Growth in psychomotor development as reported by 
<* measures of psychomotor development 
•^ Ability~ s to perceive accurately! using the senses. 

'to efficiently process information 

• Improved- "tine motor skills 
•• Improye^ visual/motor perception\ 

• Improved auditory discrimination^ 

• Ability to demonstrate mastery in\ skills in the 
areas of small motor, laterality , \directionality 
and coordination 

• Ability to write numerals, letters\and words 

• Ability" tb move and jain maximal control over 
voluntary 1 muscles 

• Iroproy^a gross motor functions 

• Impfoved_ motor development ,*~ 

• I1nproved~ self care skills * 

• Improved coordination 

• Ability to use and cpntrol a penci.l, c\rayons and 
scissors 
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Center-basea "pYekindergarten programs usually meet four or five times • 

v \ 
a*week for periodsvof two and a h|lf to three Ijours. Many begin' or ^nd wit& 

.a school lunc hi program. ;Classesa5e usually self-contained- The mo^t common 

X , . .. '\ \ 

staffing pattern is one teacher and one -aide far a group of approximately 
.twenty children: The adult to child ratio typically is officially stated to be 
1:10 but is often higher because of high absentee rates and the presence of 
parent volunteers. 

In spite of recent efforts: to make information about exemplary programs 
m available, few of .the pr^kindergarten programs observed have adopted curricula 
developed elsewhere. Several have adapted components of other programs and 
fit them to the needs of their own populations; more have developed their 

own curriculum. — ' • • 

* * 

Kinder £art en Programs 

Title I kindergarten programs often take tkeir structure from the other early 
childhood activities in the LEA. that are supported under Title I. In sites with^ 
kindergartens supported by regular LEA funds, some are downward xextensions of 
the first grade and look np:h like first-grade progragts. Jhey emphasise 
basic educational skills. In sites where there are no prekindergartens or nb 
state or local kindergartens, Title I kindergartens may be less academic. Home- 
sthool coordination is still stressed, although parent , education activities 
are somewhat .less ambitious' than they are at the prekindergarten level, and 
most programs focus directly on services for children. Parents* are usually 
involved as program resdy^ces or to< reinforce their thilferen's school 'learning. 

Organizationally, kindergartens deliver servi-ces in one c\ four ways: 
through independent classes, pull-out 4 programs 7 extended'day programs, fcr'through 
-additional support staff for non-Title- I kindergartens. * Staffing patterns ' 
^ary. Generally, Title I kindergarten 'programs have ft- higher adult to child 
ratio than non-Title*I kindergartens, but this varies considerably from . 
LEA to LEA. N m/ 

12 ' • • • 



First-Grade programs • . ^ 

, /. At present, more children tare involved iro first-gs^gejitle I program^ 
, than in either Kin<J<rgaKen or prekindergartsn programs' (Han ejfl 
»78) ; . Virtually ill Title I firtt-grade programs are -child-focused and 
cen't\r-based, and are part of, a multi-grade- level program -- typically, a 

• kindergarten-to-third-grade, first* to*thifd/gra^. or'even first-to-sixth- 

^ grade program in. reading, language arts, or mathematics.. -Like their counter- ' 
parts ar higher .grades,' first-grade- curricula .are somewhat narrowly focus'ed 
on Roosting icKi^ement iru specific academic areas. -Inmost programs,. 1 
chU te ea/ afe tutored in small groups for somewhat les? than an hour daily or' 

almost daily. For most of the ECT-I first-grade programs we visited, children 

{ ^ \ % * 

aire taken from their regujtr classrooms for §hort periods^^remeiial instruction 

.(pull-outs). Proponents of pull-out programs advocate, them because they* zr£0 ' 

• Clearly -separate" from and supplem^tary to local district programs ahd therefore 
cannot challenged -on eonqpliance grounds. Educators less comitted tapull- 
outs cite problems in . scheduling, coordinating special instruction with other 
education services, and cenfusion^or children when different materials and tech- 
niques are used in Title I and regular classroom instruction. They also fear 
that removing children J from classroom activities might result in'pejofative' 
labeling. Alternative instructional strategies in first grade include traveling 
teachers, learning centers, and resource centers. ^ • . ^ . 

Parent involvement is still a priority at first grade', but parent educatio^ 

is less^so. LEA initiated ^efforts tend to stress the parental role in reinforcing 

schoolv learning (supervising homework or providing extra drill). Parent education 

* * ■- 

'efforts, focusing on more general development al issues, emanate from PACs. « : 
"\ ■ 

Summary * 

Diversity, across and wittfin grade levels, is the ^ost striking feature o'f 




• » I program*. Generally, programs for older Children (first gra^) are more 

narrowly focused than those for younger children. While ECT-I programs all aspire 
/ to^he. sage long-term effects: increased functional Ability in the a?ea* of 
> . reading, mathematics, and language arts; their^short-term objectives may be very 
^ .different, their strategies.. for achieving 'them quite varied, 2nd their defini- 
" tipns of success strikingly- diverse. This has important implications for evalua- 
tion. ' " * . • • 

- DESCRIPTION OF ECT *I PROGRAM EVALUATIONS 

^ The report distinguishes between two types of evaluation practice: 



annual^Wsessment of program effectiveness conducted in <?rder to fulfill Title 

• *• ^ * * * - > * 

their^ yn 



I requiremeiHs, and other activities initiated by LEAs for their oyn purposes 



.Required Evaluations 

Although LEAs are rdquirefl to conduct regular outcome evaluations, no 
guidelines exist that'specify the evaluation design, the tests, or the ways 
results must be reported. Procedures^ therefore vary both from state to state 
arid from LEA to LEA within a state. There are substantive differences in the 

* ' * - ' 

technical aspects of evaluation as well as in the ability and qualifications 
.of the evaluation 1 staff. In maiy sites, the evaluations appear to be a pro, 
f orma exercise: ^^l. „ 

t 4 Hi 

-Most LEAs use a sing^jptup pretest-ppsttest design. A few use posftest 
* only or control gToup designs. Fall-sprittf testing schedules are favored, and 
often the test administered for purposes of child. selection serves. also as a pre- 
test data point. There is considerable diversity in the tests used. Most common 
are general readiness tests,- individual Intelligence tests,' and achievement tests. 
Although most BCT-I projects espouse long-term goals in areas' of language, socio- 
emotional development, or psychomotor skills, few programs evaluate performance 
-UTthese areas because of the absence*'of appropriate measure's. Program personnel 

: i • • . c: • . • , . • 
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it. general are concerned a^ouf the poor quality of tests in early childhood. 
In £ir,st grade, achievement tests are most frequently used to evaluate 

V - 

pro'gr.am # effectiveness. Tes*ts that are part of* a nationally normed^est 
series 'the Metropolitan Achievement Tests, the "California Achievement 
Test, the Conrajrehensive Test of Basic Skills, an< the Stanford Early School* 
Achievement -- are the most prevalent. These are all group administered 
tests. At the orexindergarten level, individually administered general 
readiness tests and intelligence tests are the most common. VarTous 
language-specific achieveraer.t*tests are also used at this grade, although 
no -one test predominates. Kindergarten projects draw tests from all cate-^ 
gories. Kindergartens {hat are the fir$t level of a multi-gTade program 
with a subject-specific emphasis a kindergarten-thrdugh-grade-six 

reading program) often use achievement tests. Programs with broader objectives 
tend to evaluate with general readiness^or individual intelligence tests. n 

Prekindergarten, kindergarten, and first-grade programs, are sometimes- 
reported separately, sometimes together, and sometimes in combination with 
other programs,* Reporting formats for test results also vary. For pretest- 
posttest designs using norm-referenced tests, the following reporting procedures 
are used: mean gains scores, mean percentile rank improvement, average percentage 
of maximum possible gains, 2 and NCE gains. For postfcest-only designs, projects 
report, outcomes in terms of mean posttest scores in age or gjade equivalents, or 
percentage of pupils attaining some percentile, stanine or grade equivalent cri- 
teria (for norm-referenced tests); or mean posttest scores in the raw metric (for 
non-norm-referenced tests). In addition to outcome evaluation, most states also 



T ' 1 

In -this .case, the. maximum possible gain for any individual is defined as: 

maximum possible gain ■ maximum possible posttest score minus actual pretest- 

scor*. A maximum possible gain score can be calculated for each child and 

then averaged to yield an iverage maximum possible gain. Actual gains (actual 

posttest minus actual pretest) can theh be* expressed as a percentage of average 

maximum possible gain. This method was used in only one LEA we visited. 



-ec^re descriptive information about demographic characteristics and resources 
of the Qomnta^tv;. administrative croceduxftS-for implementing the program, criteria 

• \ * " / 

for school eligibility, needs assessment and screening procedures, and procedures 

v % * *~ - • ^ 

.for assessing parent ^involvement . 



Optional Evaluations 



. Several LEAs »have initiated supplementary evaluations for their own purposes. 
ThesV efforts, "which are seldom described in evaluation reports to^SEAs, tend to 



■» . 
^ -be aimed at shedding light on .what is happening in local programs (process evalua- 
te . - . . . , * 
" tions) ; what happens to ^Mldren as a result of program participation (longitudinal 

> ■ 

evaluations and case stuiies) ; or the relative efficacy of alternative program 

practices (comparative ^nalysis of screwing procedures or progfam .components) . 
^These extra evaluation activities address general questions of "What are programs 
really doing?" and % TAQ*Jkgh they do Vt be\ter? M 

Although J(rpgfa» pirsonjiel express anAntertfst in and desire f&r mope evalua- 
tions of this type, few- .arejbeing conducted.. There are several reasons for this. 
Resources available for locally initiated evaluations are scarce. Moreover, 
except in large, well -funded LEAs, evaluation staff are not 'trained to conduct 
sophisticated evalyationg^ Resources from SEAs are generally not available for 
\ optional activities. ( TACs concentrate on helping to implement the proposed USED 
models in grades two, to twel>&. LogisticNaa* technical obstacles thus hinder 
efforts to produce evaluation information aimed at meeting specific I^cal need*. 
Resources Available for Evaluation 

'{ — 7 — 1 — 1 

In general, resources available at the state. level seem insufficient 
to provide extensive assistance to LEAs in evaluating 'their programs* This is 
particularly true for early childhood programs. At the local level, available 
resources var>vgrea£ly. $ome large LEAs have large and sophisticated evaluation 
departments. Others, usually smaller j have much more* limited facilities and staff. 
The fAQs represent an important p^ential resource for .assistance .£n>valuat'ing 
* ECT-I programs that\as not yet been fully tapped. 

E£IC ' if} 
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Use of Evaluatign* Information* at jthe State Level ' * . * ; 

State 'officials' use of information gleaned from evaluations \$ very limited. 
The primary Use of results is. to prepare the annual report for the USED. Some* ' 
states use the annual evaluation in conjunction with the monitoring process to. \ 
insure compliance with federal regulations, maintain contact wiife LEA personnel, 
give informal technical and program advice, ?nd deten^ne where to place emphasis. 
Other states use it to defend--or to urge elimination of--specific programs. 
Use of Evaluation Information at the Local Level 

£CT-I evaluation Information is used and valued differently across LEAs. 
In some sites LEA personnel ^reported that if they were not required to evaluate 
their ECT-^ programs they would not do so. .Others found evaluations useful. 
Among the uses reported were: to assess program effectiveness, to imprpVe practice, 
and/to train staff. However, most see a number of difficulties in accurately 
and adequate ly assessing the effects of intervention on very young c^ildi^n.- 4 
They agree that short-term impact^ evaluation is insufficient and plead for 
longitudinal evaluations. They are also concerned about the limits placed on 
evaluation efforts by the quality of early childhood tests, and measures. 
Available tests are .gertefally inadequate fojJ accurate assessment of the full, 
range of ECT-I program goals /particularly in the areas of social and emotional 
growth ^psychomotor development, and/language. The program staff thus do not 
regard thes^tests as satisfactory to select children »for ECT-I programs, to 
• diagnose individual needs, or to evaluate program effectiveness. Many LEAs 

' therefore have 'developed criterion-referenced tests r^Jated to their own program. 

* 

> 

ANALYSE OF ECT-I PRACTICE * * * 

. *v . - - ( 

ECT-I Trends Compared with Trends in Early* Childhood Education r 

In the first phase of this study, Haney«(1978) identified some major trends . 



in early childhood education.. These include: making early childhood educatien 
public and coordinating educational program's at the state level, an increased 
number-of early childhood education programs, increased emphasis" on parental ' 
involvement in programs for young children, individualised programs to meet 
children's specific needs, mainstreaming or integrating children with srecial' 

e • % * 

needs iAto .regular classroom activities instead of segregating them' into special 
. classes *and multidisciplinary comprehensive sen-ices for disadvantaged children. 

While all of the general trends appear in ECT-I programs, they tend to 
be variously shaped by the requirements" and regulations of Title I and the ways 
ehey are interpreted. The Title I mandate for local needs assessment and deter- 
mination of programs to meet the # needs identified contrasts, for example, with th< 
general trend toward coordination o* early childhood programs at the state level. 
The requirement .that Title I funds be used to supplement rather than supplant 
existing programs also clearly contrasts with the general trend toward incorpora- 
tion of early childhood programs into existing public school programs. While 
ECT-I programs often do make early childhood educirion programs puMicly available 
for some children, unlike early childhood programs in. general they have not 
increased in number since 1976. If .anything, efforts in this area have diminished 
slightly, at least at the prekindergarten and kindergarten level (see for example 
tn*e Annual State Performance and Accounting Reports prepared by the Division of 
Education forth* Disadvantaged). 

ECT-I programs also diverge from the general .trend in that they emphasire " 
basic academic skill* more heavily: Virtually every progra? description includes 
primary objectives in the areas a& readin^or reading readiness, language acquis!* 
tion or language fcrts, and mathematical reasoning and computation. { Beyond these 
narrow objectives, hdbever, most prog^ms also' include important instrumental go^ls 
in one o^more of *the folloning areas: social growth and development, perceptual- 

18 
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aotor Or .?sy<^omo*tor development, gTOss motor development, behavioral organiza- 
tion, and motivation. In early childhood programs, there is often substantial 
' tension between interpretations of Title I requirements for academic emphasis 
and the broader goal? of current early childhood education practice. 

• 4 - 

In other wayj^ ECT-I programs closely approach broader trends in early 
childhood education. % Mbst notable is the increased emphajis on parent involve- 
me'fft and parent education, particularly in programs for very young children. 
Thi-s njjiy be attributed both to greater parental interest in fVograas for their 
very young children and to purposeful program outreach.. Individualization is 
also important in ECT-I programs, although it is not always rigorously 
implemented . For example, it is most, often done only by means of 
skills profiles generated from tests or curricula. Every child - is -assessed on 
a continuum in each of a number of skill or developmental areas. Children 
whose profiles show similar needs are then grouped for instruction. Profiles 
are reviewed periodically and instructional goals adjusted. , 

The importance of aainstf earning a^an issue varies with ECT-I level. At 
prekindergarten *the issue is usually moot, for these programs exist independently 
and children are not drawn Gut of other educational programs. Where other 
t programs exist, however, particularly at fifst grade, the desire to mainstream 
children often conflicts VitJr ttfe ^nd^ejLlj9,!sup£leme^ rather than supplant 
service.s. Once again, concerns about Title J requirements appear to diverge, 

\ * 

from clinical judgments on appropriate educational practice . 

/ ' 
Finally, perhaps because of the focus on.basic skills, ECT-I programs stress 

i 

+■ . • 

comprehensive services less than do early childhood^programs generally. Th^ • 

% ' 

task of E(fr— I programs is narrowly defined, and Sjjpplementary services are ofiten 
tfiew^d as* peripheral' or even precluded by Title L 

// . • 
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* * * 

• Nteds Assessment, Recruitment and Selection 

, \ > In -grades two^ through twelve, Title I provides* supplementary educational 

services for those chi&Hn in low income neighborhoods who are. designated "educa- 

* • • • 
* tionally deprived./ r In tftis respect regular school programs fulfill several important 

functions for Title I. They generate local normative criteria for determining educational 

disadvantage. -children's inabilrbv to perform at a level comparab\£ to that of - 

their peer's. They also allow readx li^ntification -of children who sWld be 

^served- -those having tfce most difficulty Tbsschool . . Finally i regular sckbol 

programs have some 'statement of goals, objefctiXs, and curricula, and these pfcqyide 

a base for deciding what additional services Title I should provide.. 

The situation with ECT-I programs is very different, particularly in pre- 

kindergarten. Unlike later-grade programs,* prekindergartens. are self-corytained 

' # 

and usually have no counterpart within the public school system. As a resuK, 
there are no normative criteria for defining educational disadvantage. More- 
over, neither child development theory nor clinical practice, clearly defines 
-educational disadvantage for a child before entry into public school, or the 
functional competence necessary to assure^ later academic Success. In addition, 
sincepfeschool programs stand alone. and serve a limited number of children, 
no„infoffiation exists on the past development of all children in the district, 
nor is there ev^n a list of potential candidates' for ECT-I services. This 
greatly complicates the tasks .of needs assessment/ recruitment, and screening. 

Needs assessment . Needs assessment is the process by which lEAs determine 

» 

which groups 6f children in areas eligible for Title. I are most in need of 
.services, and what services wiTt^u^ the highest district priority. The most 
common methods^ of needs assessment are grade-by-grade examination of pupil test 
performance, teacher observation, teacher or parent surveys, and analyses' of 

r previous Title I evaluation results. -However,* while these strategies may be 

s 

ERIC .20 . . 



/ 




•18- 



appropriate for students already in the - district school* program, they are 

inappropriate for prekindergartfe and kindergarten. The absence of normati :t 

' ' • \ * , ' . r-- 

criteria for educational disadvantage at this age and the. poor predictive 

validity of current assessment measures mean that program planners must extra- 

pcl3te fror. .failure at later grades. to needs atsearUer a S es - This is particu- 

larly problematic si^ce needs assessment often "influences- -or at least is, 

used to justify—major program changes, such as. extending a program to unserved 

J ' 1 A 

•gradf levels or eliminating program components at other levels. 

Recruitment . LEA -staff report using severaJLjnethods or combinations of 

) 

me;hods to identify and recruit students. These include the following: contact- 

* » 
xng younger siblings'of former .ECT-I participants or children receiving Title I 

services in other grades; contacting otAer community" service agencies (visiting 

nurses, well*feaby clinics, churches, social service departments, and the likep; 

posting notices in local newspapers and stores; and sending teachers to homes 

in eligible- neighborhoods. There is some question whether these efforts reach 

• * * * ♦ • . 

all children who need services. While the LEA staff generally, feel that the 

children they recruit do need services, they -fear they might be missing others 

who also need educational help". v — 

% Selection . Beyond the requisite of residence in an eligible area, LEAs 

must establish criteria for selecting children to be served. For ECT{l .programs , 

some combination of the following is commonly used: 

, • a low score on a test or series of tests;, 

t teacher judgment; 



• a sibling ^o is or was a Titlfe I student; ^ 

r • 

• parents with fc&ss than a high school^education; ~ 

I ; 

• inability to understand the language of instruction; jmd 

t parent judgment. \ t 



7rtere is ne obvious way of appropriately weighting the various factors, howevet. 
Virtually every LEA uses $omt form of a ^standardized* test as part of the selec- 
tion process. The extent.(tp^hich lEXs rely on' these tests in making their 
decision varies considerably. i***qne extreme, test scores constitute a virtual 
decision rale, although jcut-off scoid* differ across states and LEAs . \z the oth 
extreme, it appears that tests are used.primarily to satisfy pctentill compliance 
inquiries; 'actual selection decisions may be made by other criteria. At a more 
central position., test evidence is used in conjunction with teacher judgment. 
If teacher judgment overrules test evidence, additional testing is often done to 
support the decision, 

t Manipulat ing the system . Th^needs as>es?aent, recruitment, and selection 
processes 'can be manipulated to include or exclude children. Some projects have 
too few openings for the number of applicants ajid must reject some of "them.' Some 
times the solution is to screen all applicants and select the children with the- 
lowest scores. Since test scores tend to cluster, teacher or tester judgment 
is added to the decision-making- process. Mternatively, LEAs establish a. test 
score eligibility criterion and test children on a first-come-first-served basis. 
When they have reached the maximum number of children they can accommodate who 
meet the s criterion, they simply stop testing. Making the information available 
to some families before others exacerbates the natural selection bias and almost 
assures placement to the groups first notified. For example, -one LEA always 
posted notice about the screening in one housing project first. Not surprisingly, 
since they used a first come - first s"wved procedure, most of their children came 
from that project. Few came from another more "difficult" project when? testing 
occurfed later and there were few placements left. 

There is considerable difference of opinion at both the state and the local 



level ^Tbout what is necessary to comply v witn tne law on the oneTianJ, and what 
constitutes .good educational practice on th* other. In the selection of children 
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for ECT-I programs, this ambiguity allows considerable latitude for decision 
makers to be responsive to local, priorities, as well as raising the possibility 
of abuse. 

Organising 5€T^I Projects to Deliver Services 

Resour ces. A conspicuous feature of early childhojod programs is the purpose- 

- r 

ful interaction cTf play and learning ^tivities. There is abundant*evidence that 
young children learn thrdugh play. What and how they leam depends greatly on 
the type, of material and play experience provided. When these elendhts are care- 
fully chosen to match the abilities and interests of the children involved, they 
both facilitate the learning process and provide the content. They enable child- 
ren to engage their curiosity and use their initiative as they leam. They 

also can yield diagnostic information to teachers. 

Almost without exception, ECT-I programs are well equipped with a variety 
of material and instructional aids. Material is of two major types: equipment 
for exploration and frecplay (e.g., art material, puzzles, or sorting games), 
an4 structured learning material (e.g., programmed language kits). In *prekinder- 
garten and kindergarten classes, most material is of the first type; firsi-grade 
classes generally use more structured material. 

. The shift in emphasis from prekindergarten to. first grade reflects the change 
from an educational approach tailored to each child, to one with comnon objectives 
to be. shared by all the children. Moreover, it reveals theoretical ambiguities 
about what children should be doing and raises \important pedagogic issues. From 
a perspective that stresses program content and short-«ra\a?hievement, it jLs 
appropriate. From a mpre cognitive developmental position emphasizing long-term 
effects., *it can be argued that first-grade children with educational deficits 
stijl need--and are. most in need of--concrete experiences before moving on, to 
symbolic activities. Currently, however, these children are the least likely 
to get them. Being the least likely to cotoplete the required symbolic school, 



tasks, they may seldom have opportunities for mdre concrete exploration. 
s The space available for ECT-I projects is 'not optimal. Restrictions on 
building, increastd constraints on local school spending, and a general sense of 
low priority for ECT-I programs seem to contribute to the deficit. Program k 
.personnel use available space differently. Most prekindergarten and kindergarten 

* ) m 

classes are arranged into three. kinds of areas: a group meeting place, 

» • 

individual interest areas and areas' for solitary play. First grade. class 
space is usually organized around desks for individual children. 

The adult resources for ECT-I programs vary considerably. , Most -EAs use . 
teachers, aides, and specialists jn particular subject areas. However, they 
define the i^les differently and Combine them ,in a number of ways., The tasks 
and responsibilities of aides are roost conspicuously different. Classroom 
personnel are supervised and their activities coordinated by special administ?a- 

> • ^ 

tive and technical assistance personnel. t 

Curricula . ECT-I programs that are adjuncts to regular school programs must 
be distinguished from those constituting entire programs at a particular 
level. -The former^ for example first grade reading or reading readiness programs 
take 4?heir objectives from corresponding regular school activities. Jrhey simply 
extend the instructional services to children who are having difficulty or pro- 
gressing more slowly than their .peers through the regular school curriculum Whol< 

programs,- most frequently at the prekindergarten leye], on the other hand, must 
identify curricula from other programs' or develop new on*s. Injthese cases .the 
linkage between ECT-I programs and programs in later grades is often tenuous. 

Many prdjects-are develdping their own curricula. These often include a 

. * 
"comprehensive set of behavioral objectives or criteria, organized in developmen- 

tal sequences and^pecifying age, gradt, or developmental level expectations. 

They also suggest appropriate activities an<f materials helpful in teaching 

children to these criteria. - 
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* There. is reason to be cautious about such 1 efforts. Criteria and selection 

of items are often "only face valid. The eclectic approach^ used co set objec- 

I > 

tives and define curricula involves borrowing from other/programs and drawlBg * 

i 

front books and clinical experience. This can result id a rich progrkm adapted 

* / 

' to' locajf^res.ources an d^ individual children; but it can al # so result in superim- 

*' - .* / 

* 4 posing theoretical positions on one another regardless of fit. The program then 
becomes a collection of bits and pieces of varioiis early childhood practices 
with.no coherent structure. j 

The organizational structure of the various curricula and hence the eraphasi^ 
prlaced on objectives differ from place to place. Some ECT-I programs use a 
developmental area organization while others focus on subject matter. A- typical 
developmental area organization would^focus on fc some o'r all of the following: 

t 

• the way the child perceives the world (auditory and visual perception); 
4 • the' wav the child controls his body r and integrates information from his 

senses (gross motor skills, fine actor skills, perceptual motor intefja* 
tion, perceptual motor skills, and psychomotor skills); 

• cognitive status (conceptual development and problem-solving skills^; 

4 7 

• capacity to organize behavior' and maintain attention (attention span^ 
task initiation, task directedness, independence, and executive ability) ; 

• language ability (expressive language and comprehension); 

• social and emotional integrity (self concept and relationships with- 
other^. 

A subject area organization might focus on: ♦ 

• reading and reading readiness (e.g., letter recognition, word decoding 
^ skills, or vocabulary development); 

t language arts (integration of reading, writing, and spelling); and 
. • mathematics (e.g., number recogrtition, simple arithmetic operations, 
# and shape and spatial relationships) . * ' 

# » 
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Examination shows that the two pe/spectives overlap considerably. The appar- 
ent difference is one of perspective. From an elementary school perspective the 
logical strategy is to extend downward into^ early childhood programs the subject 
matter structure developed in the la£er grades. People trained in early childhood, 
education, h6vever*, focus more' on basic developmental areas^' More important, how^v 
is the way teaching^staff relate the objectives to instruction.* Again, one of the 
central themes of our report emerges. On the one hand, there is the we^k and poor!, 
understood .link between early childhood experience and Competent functioning in 
school, dn - the oth^TTgiven the general Title I.focut on the developmen£ o 



basic skills and on accountability, there is an increased push toward molding 
ECT-I curricula in this direction. The face valid way of doing this is to impose 
subject area" objectives on ECT-I programs--but this runs counter to much current 
developmental* thinking about appropriate early childhood education. 

This dilemma is manifest in* the difference between formal descriptions of 
ECT-I programs (written documents and Title I applications) and informal accounts 
-(teacher comments and fie^d staff observations) . The programs as formally de* - 
scribed usually emphasize achievement-related objectives, whereases implemented 
they often reflect ;nore comprehensive developmental 'concerns . N 

Individualization . A conspicuous feature of a great many ECT-I projects 
is the awareness of and sensitivity to issues of individualization. However, 
ways of individualizing programs for chilg^en differ. The typical way of individual 
izing instructional to develop a skills profile on each child, usually bksed on 
whatever scores are available from selection or evaluation pretests (published / * 
or locally developed tests). The profile gives an indication of tlie mastery . 
^level in the aWT'assessed by the particular test. Teachers use the profile 
to monitor the child's progress, checking off new skills and understandings'*! - 
they occur. Some programs use procedures* borrowed from the diagnostic/prescriptive 
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models developed in special education (see, for example, Gallager, 19*4; 
9 Meiseljs, 1977),. These involve a multi-step process of in-depth, aulti- 

disciplinary evaluation of each child's strengths and weaknesses, a written <S 
diagnosis of education needs, and an individual education plan drawn from suk^/* 
sets'of the project 1 $ t general objectives that* matches^ instructional techniques 
to the child's learning style and interests. 

• Implementing individualized programs is difficult for several reasons: few 
good diagnostic tests are available, at^fewer still link assessment with' 
instructional activities; special support services are necessary /but often 
-unavailable; 'expertise 4n diagnosis and prescriptive teaching is limited; 
erttcmsive record keeping requires £ major tiarf' commitment . In programs where 
^individualization is thoroughly understood and carefully implemented, educational 
experiences are 'designed to maximize each child's^ easting skills, abilities, and 
interests in ordjy to improve performance in weaker areas. In programs where 

individualization is not well inplemented, the results may be more form than 

» *> 

" ^substance. In our judgment, technical assistance is needed in this area. 
ECT-I Within the Larger Context 

* State influence on ECT-I programs * Under Title I, responsibility for 
defining programs and the ages at whidi they are to be offered rests with local 

education agencies.. This responsibility is implemented through # a multi.-step 
. v ( 
• process- that includes determining school eligibility for Title I funds, identify- 
ing most pressing educational needs within eligible sc£od|^t (needs assessments) , 

planning and providing services to best meet those needs, and selecting children 

* • 

to receive the services. ' LEAs must sufply assurances to the SEA that they HSve 
•taken 'all of these- steps in compliance with applicable regulations. 
SEAs', oh the other hand, are respc^Tible *for: 
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. k 1) assuring proper jvnd efficient performance of LEA duties under Title I; 

2) providing technical assistance .with regard to measurement's and evalua- 

<•. , " 

A tions LEAs are. required (to submit; 
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3) - reviewing applications and approving them if they aeet all applicable 

requirements and da not exceed available funds; and 

4) providing adequate notice and opportunity for a hearing in case of 
disapproval of the anm'%1 aJ^caft'Ofc^nd specifying reasons -for the • 

-disapproval (Table I, ESEA , "section 141 an'd 44: : 4SK FR Part 116.4 and 

While in principle the "separation of powers" seejs clear, in oractice , 

there may be some ambiguity. Although SEAs have no authority to determine the 

content,, structure, or age levels of programs funded under Title I, we observed 

a considerable amount of across-state variation in the number and type of ECT-I 

programs implemented. In^ the .states visited, SEA representatives have definite 

priorities for ECT-I program implementation. At the state level", there sterns 

to be a slight trend toward decreasing^he number of ECT-I programs, particularly 

in prekindergarten. In addition, most SEA officials favor academic achievement 

programs. While they do not require that programs be limited to academic - 

readiness and achievement, they suggest that these are the sine qua non for 

Title I funding. A few SEA officials argue, hcrtever, that in early education 

programs these skills can be addressed only within the context of integrated 

personal,, social, and cognitive development, v . 

Several SEA representatives give priority to individualizing programs. • 
• . * • * 

Pull-out programs, learning centers, mainstreaming, and continuous multi-grade 

w * 

Rrojiects have supporters at the state level. In most cases, however, 'state 
officials are somewhat vague, about what actually happens »in ECT-I classrooms, and 
tend to leave decisions aboQt teaching strategies to the LEAs . . 

SEAs are charged with monitoring the effectiveness of Title I programs ' 
within their state. They therefore have a genuine interest in the evaluation 
procedures and instruments used. In general, SEAs that emphasize basic educa- 
tipnal skills programs, even at the early childhood leyel, favor evaluation 
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raetfcotis using norm-referenced tests, while SEAs thtt' emphasize developmental 
approaches tend. to favor criterion-referenced tests or. observations . 

Is' : 

t . Coordihation of - Title I with regular school programs . In most programs, 

f 

Jltle^ and district personnel are working toward the same gcals and using 



similar curriculum materials. However, in a few instances their methods are 
purposely different--an extreme illustration of the heed to .supplement rather 
thitf supplant local ^^^ces. Coordination of ^Individual education plans is 
more variable. ^Programs differ in the types of information, shared between 



■ classroom teacher and Title I teacher, in frequency of contact, and in the form 
of reports. 

Operatiorfal challenges to smooth progTam implemen^^iOT^i^4jde_dif f iculties 
ECT-I services $£ as not\o conflict with other valuable "classroom 
activities or with - communication between Title I personnel and district staff. 
Opportunities for the latter are reduced by busy schedules and'offices located 
iji different buildings. One strategy for bridging the communication gap is to 
conduct joint in-service training sessions. . 

Continuity across grade levels . * Continuity of program experience has been 
a major issue in the early childhood literatufe. It is also a concern for ECT-I, 
In general, ECT-I programs seem to be more successful^than other early education 
programs in establishing and maintaining continuity of education experiences for 
young children. * Some programs attempt to provtte continuity by including the 
ECT-I program in a continuous multi-grade program. Others do so by extending 
curriculum goals or criterion-referenced materials for the, elementary grades 
downwird to meet the needs of four- or five-year-old , children. 

The most troublesome transition is between prekindergarten and later pro- 
grams. Prekindergarten programs often develop independently of elementary 
programs and tend' to be broader in scope and .more comprehensive ixr the services 
they provide. A pedagogic shift occurs between early childho^ education and 
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t>3:2ie? v :c instruction in the elementary grades. The former focuses more 
on the "child, the latter on program content. Moreover, ECT-I programs are 
often administered' ani housed separately, further complicating the continuity 
issue/ * 4 . 

Relationships with other programs . A staggering array of > additional , 

funding services and. programs is. avaii^able%o children eligible for ECT-I? In 
some sites, several funding sources are combined within a single classroom. In 
others, one source i-s used jxr^feHly at some grade level* and alternative 
sources are. used at others. The constellation of programs 'is almost ^unique 
for eajch commtj^ity. Our rep9rt focuses on the relationships between ECT-I pro- 
grams and two others:. Head Start- and special education. 

In most cbwnunities 'there is little or no communication between ECT-I and 

• ; . j 

Head Start programs. In some, there seems td be competition for children or 
-'envy at disproportion*** resources available to one program or the other. 
In others, staff coordinate resources. Some communities report an unofficial 
status hierarchy, fron-Head Start to Title I to special education. <Ofd nature ^ 
of the relationship between programs seems to be determined by a number of 
factors 'including: the administrative framework for t)\e two programs, the 
resources # and services available to each, the eligibility criteria used^ the' 
way, placement dectsions -are reached, and the adequacy of all early childhood 
services to meet .the total community need. 

The relationship between ECT-I and special education services is particu- 
larly complex, reflecting differences in state special education Taws and n the general 



lack of clarity ^out the requirements for implementation of PL 94-142. There is -much 
concern and confusion about what services will be provided from what ^sources, 



how services might ^e. shared, and how decisions should be made about services 
for individual children.* Eligibility for ECT-I and for special education is 
often difficult to distinguish in early childhood, and there is some anxiety that 
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children •►will be placed in the wrong program?, 

\ Mapping individual needs to available programs is a salient issue in most 

LLAj. For each of the three programs, ECT-I, Head Start and special education, 

^ , % * . 

there is*a screenth^ or selection, process that marks; entry into the system. 
Some LpAs are beginning to try to coordinate screening, procedures . 
However, i-n most they exist independently. It is up to parents t^ initiate 
entry into, the various programs and the choice often seems to be determined by 
informal, personal networks rather than an informed, rational decision-making, 
process . * 

PARENT INVOLVEMENT 

Increased parent involvement is a trend noted in early' childhood education 
programs generally, and in ECT-I programs in particular. This is influenced 

by two conditions. First, there is abundant evidence that eaflv education 

* • * * 

intervention programs by themselves tend not to produce long-term effects on 
children. * However, programs more likely to achieve sustained effects are tHose 
ttfat involve parent participation. Second, tfie political climate of the titees 
forces programs to be responsive to the people they serve and the primary 

mechanism for this is.*parent participation. Thus, two Forms of parent involve- 

• » 

ment emerge: parent education and parent participation. 
Parent Education 

* »* * • 

We distinguish among three types of parent education: those directed 

^ ✓ .? 

'at changing parents* knowledge, attitudes and behavior as they are focused on* 
their child; those directed at changing parents' knowledgl, attitudes and the<., 
nature of their interactions with school services and personnel; and those with 
objectives that go beyond the parent role and try tr^aeet^the personal needs of 
parents as adults. ECT-I parent education programs are found in only the first 
two categories. "Examples of objectives for each are summarized in Table 2. 
Parent education in ECT-I is a local option. LEAs implementing parent education 
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Table 2 ^ 
•Examples of Parent -Education Goals 



Produce 
Change in 
, Parent V : 


r 

* ^ Fo< 

, TowardN^nld 
_ _ 


MS ' . 
Toward School 


Knowledge 

» 

> 


« / 

To understand health, 
nutritional, and deatal 
needs of children; 

To know what play materials 
are appropriate^ at different 
ages. 


To°be aware of services 
available and how to use them, 
e.g., referral for special 
education; ™ 

To know what tasks their child 
is working on in school. 

, T 


Attitude ' 

• 

^ — 


1 ' ' ' * 

To appreciate their child's 
characteristics of teaperaaent 
and J earning; 

To de^lop realistifc Ifid 
• flexib.l* expectations of 
their child. v 

V 


E 

To trust school personnel; 

To view theaselves as helpers 
in the education of their 

child.. • 


Function 

- > 

/ 


v To change veWal behavior; 

m . Y • 

To change patterns of 
responsiveness. \ 

r : 


u 

* 

To seek appropriate services, 
e.g., referral for special 
education; 

To initiate and attend 

conferences with teachers with ► 

appropriate frequency. 



• '* 
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programs argue that parents of educationally disadvantaged children theaselves 

1 i # • 

need education and training, 4 

The goals c^f ECT-I parent education programs are to improye children's . 
jchool readiness and academic performance by teaching parents to teach their 
children. As with so many other features tf ECT-I programs, there are conspic- 
«uous differences in parent education efforts across grade levels > In general, 
'LEAs .tend to place heavy yfemphasis on parent education' for thre>-yeaV^olds , 
equal emphasis on parentf educa^fch and child-centered programs for four^ and 
five-year-olds, and less emphasis on parent education thereafter. 

Parent education programs are organized ii^one of three ways: as inde- w 
pendent entitie^ as comp^ents of classroom programs for children, and as 
informal adtf-ohs. Many programs are home-visit programs,. Others bring parents 
together in small groups- A few confine parent atid child classroom activities, 
Issues in implementing parent education programs . .There are several chal- 
*leng*s to successful parent education efforts. First, there is no consensus on 

' ajjpropriate goals for parent education. Parental needs vary with individual 

-1 & 

capability, family strength, and child characteristics, and it is necessary to 



individualize programs for families. However, doing so is difficult and time 
consuming. Second, there is a paucity of good materials for use in parent -educa- 
tion. LEA staff often must develop their own, and this takes time and talent. 
Third, ^tost ECT-I ^taff are trained to work with children, not adults. Excellent 
teachers of young children are not always the best teachers of parents, so 
additional, training and support are necessary, though not.alVax* available. 
Final Ijjj^pro gram accountability i^V issue. 'Particularly with home visit pro- 
grams, it is. difficult* to assure .that what actually happens is consistent with 
the program as planned^ 



Prograa personnel' in LEAs with parent education projects are convinced 
.of the efficacy of- these efforts." They feel that Che children of parents who 
participate have better attitudes toward and do better in school, and that 
parents are better a£le to use -school resources and to function as idvocates 
for their children, ftowpver,. evaluating tjiese, activities with any degree' of 



or is difficult, hampered by both logistic and technical constraints. 

Parent Participation y / 

- V # , _ 

Three forms of EtT-I parent participation are identified: resources to 

the prograa, informal political- agents, and parent advisory councils. The 

first includes serving as classroom aides, observing and evaluating programs, 

building playgrounds or helping with special activities. The second includes 

writing to congressmen and other public officials in support of or in opposi- . 

tion to legislation^ The third is defined by the regulations of Title I and 

implemented accordingly. 

Evaluating Parent Involvement * * 

Some aspects of parent involvement must be evaluated ^and parent education 

is one of them. However, it is' difficulty do so adequately, and in general 

LEA staff are dissatisfied with the ways the parent education programs are being 

» * 

* 

evaluated. They argue that in their program they strive to improve parental 
competence and attitudes so that children may reap the advantages. Children 

r m 

whose parents participate in these programs should be more advanced- in some 
measurable way than children whose parents did not participate. Therefore f jf 
evaluatioj^in these project's generally takes the form of short-term child impact 
studies. These evaluations clpsely resemble tljose of child-centered E£T-I pro- 
grams,' despite the fact that prograa goal*' and activities may be quite different 
Par f er*t educators, however, argue that short-term impact evaluation tells 
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only part of the story. Sin.ce goals and objectivea'of parent education programs 
; include changes in parents' knowledge, Attitudes afcd function, tflese areas 
should 41so be assessed, Moreover, effecting su<fh parental change is aprje * ' 
likely to have long-term consequences for children thin it is to significantly 
effect short-term change. Therefore, they advocate longitudinal evaluations. 
Finally, rpany LEA staff Jeel that their programs have considerable diffusion 
effects, They would look for ways in which parents understand and deal more 
successfully not only with the ECT-I chtti* but also with his or her siblings. 
They would also assess increased competence in using school and comunity 
resources. ^ 

f Evaluation of parent education is impeded by>the paucity of instruments 
for measuring parent growth. There simply are no standardized and few widely 
used instruments for measuring -changes in parents^that might be expected as a ' 
result of participation in parent education projects. Alternative strategies 
used by some programs include observations of parent behavior either at home or 
in a controlled situation, parent attitude scales , .questionnaire* or unob- 
trusive measures of parent attendance at meetings, "home visits oz, workshops . 
Many programs use a combination of seyeral strategies. 

We see, then, two factors that constrain efforts at more adequate evilua- * 
tion of ECT-I parent education programs. First, the Title I regulations require 
that all programs must impact the child so the'majority of evaluation resources 
are devoted to ascertaining that impact, Second, existing evaluation strategies 
and measures are simply not capable of sorting out the linkages between changes 

in parent knowledge, attitude and functioning on the one hand, and short-term 

. f 

or sustained ^ffects on their children on the other. 
SUVflARY 

We suggest that 'the development of ECT-I programs has been influenced by 

- ... * 
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~\A(a.force$: specific requirements, regulations, and interpretation of Title 

I, and general early childhood education fheor^and practice. The two overlap , 
in some ways but seldom map directly onto. one another. Several points of 
conflict have implications for program practice and evaluation. First, because 
> there is no consensus on the definition of educational or academic deficit in 
- early childhood, it is difficult to establish criteria for the greatest need. 
This complicates needs assessment, the Selection of children^M-ECT^progTams-, 
and the design of programs. Second, even if ^ucat iortgfjeficit is operatio n- 
ally defined, it is not clear that there is any «ay to prevent later academic 
failure. Educators may differ on the nature of the problem and on optimal inter- 
ventjoo strategies. .The result is a variety of programs, and a multitude of 
curricula *ith a wide range of goals and objectives. These objectives are 
organized by some into domains of child^developraent; by others, in terms of 
standard, curriculum subjects. This diversity among programs and multiplicity 
of. goals within programs complicate? the task of developing a unified system 
of evaluation models. Third, the state of"' the art in early childhood assess- 
**ent also creates problems. Tests for both selection and evaluation of children 
, are limited in number, narrow in scope, and of ten of -low technical quality. 
This makes difficult the task'of needs asJfcssment, child selection, and program 
evaluation. < j 

' ' rr. 

fc * 

^yf^nv conclusion, however, we should note that whi4e the diversity of ECT-I 
' programs may present challenges--in program administration, coordination with 
other programs, and especially in evaiuation--it may also represent a real strength. 
As our literature review shows, many of the programs identified as exemplary on . 
the basis of systematic evaluation were ECT-I programs. Indeed, their number is 
disproportionately large whery:ompar*d with the proportion qf Title I resources 
going into early childhood programs. . This^may be due to several different factors, 
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such as characteristics of early childhcfcd tests and instruments, or the -nature 
of child development. But it may also reflect the- fact that the diversity 
apparent among ECT-I programs has made it- possible to match programs to tS^^-y 
particularneeds of local communities and the specific needs of different groups 
of educationally deprived children. Thus, .despite all the administrative and 
'evaluation prohleras which it may, cause, this diversity should be viewed as an 
important, real and potential strength of Title I efforts^t the early childhood 
level. It should not be constrained lightly, however attractive it might be to . 
do so for the sake of administrative or evaluative efficiency. , * 



* 
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